Augmented Reality System using a Smartphone Based on Getting a 3D Environment Model in Real-Time with an RGB-D Camera
نویسندگان
چکیده
In this paper, we propose a system to achieve Augmented Reality (AR) on a smartphone. In this system, we assume a fixed RGB-D camera connected to a server is installed in the environment, and perform AR based on the 3D environment shape got by the RGB-D camera in real-time. On the smartphone side, it sends the image captured by its camera, and receives the output image processed to perform AR by the server. On the server side, it sends back the image that virtual objects are superimposed on. At this time, by constructing the 3D environment model in real-time using the RGB-D camera, it is possible to calculate the smartphone pose and the interaction between the virtual objects and the environment properly. It is also possible to change the lighting virtually. Our experiment revealed it is possible to superimpose virtual objects on the smartphone in approximately 8fps.
منابع مشابه
Overview of Performance and Accuracy of Smartphone Sensors in Augmented Reality Applications
Since incorrect excavations have resulted in extensive and irreparable financial and physical losses, therefore different drillings require having accurate information about the status of the infrastructures. Ubiquitous Geospatial Information System (UBGIS) as a new generation of Geospatial Information System (GIS) can be a good solution to avoid such problems. Augmented Reality (AR) is the ne...
متن کاملReal-time image-based RGB-D camera motion tracking and environment mapping. (Suivi de caméra image en temps réel base et cartographie de l'environnement)
Tommi M. Tykkälä Real-time Image-based RGB-D Camera Motion Tracking and Environment Mapping Helsinki, 2013 148 p. Acta Universitatis Lappeenrantaensis 533 Diss. Lappeenranta University of Technology ISBN 978-952-265-473-1 ISBN 978-952-265-474-8 (PDF) ISSN 1456-4491, ISSN-L 1456-4491 In this work, image based estimation methods, also known as direct methods, are studied which avoid feature extra...
متن کاملAR Visualization of Thermal 3D Model by Hand-held Cameras
In this paper, we propose a system for AR visualization of thermal distribution on the environment. Our system is based on color 3D model and thermal 3D model of the target scene generated by KinectFusion using a thermal camera coupled with an RGB-D camera. In off-line phase, Viewpoint Generative Learning (VGL) is applied to the colored 3D model for collecting its stable keypoints descriptors. ...
متن کاملDirect Camera Pose Tracking and Mapping With Signed Distance Functions
In many areas, the ability to create accurate 3D models is of great interest, for example, in computer vision, robotics, architecture, and augmented reality. In this paper we show how a textured indoor environment can be reconstructed in 3D using an RGB-D camera. Real-time performance can be achieved using a GPU. We show how the camera pose can be estimated directly using the geometry that we r...
متن کاملBeyond 3D "As-Built" Information Using Mobile AR Enhancing the Building Lifecycle Management
The success of smartphone technologies changed the way information is processed as more and more geo-referenced structures are emerging linking information to specific locations within our environment. Thereby, Augmented Reality has become a key technology as it analyses the smartphone sensor data (camera, GPS, inertial) to derive the detailed pose of the smartphone, with the aim to correlate o...
متن کامل